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Abstract 

In this paper we study the optimal stopping problem for Levy pro- 
cesses studied by Novikov and Shiryayev in |10] , In particular, we are 
interested in finding the representing measure of the value function. 
It is seen that that this can be expressed in terms of the Appell poly- 
nomials. An important tool in our approach and computations is the 
Wiener-Hopf factorization. 
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1 Introduction 



Let X = {X t : t > 0} denote a real-valued Levy process and the proba- 
bility measure associated with X when initiated from x. Furthermore, {Ft} 
denotes the natural filtration generated by X and Ai the set of all stopping 
times r with respect to {Ft}- 

We are interested in the following optimal stopping problem: 

Find a function V and a stopping time r* such that 

V(x) = sup E x (e- rT g(X T )) = B x (e~ rT *g(X* T )), (1.1) 

where g(x) := (x + ) n , n = 1, 2, . . . , and r > 0. 

It is striking that the solution of this problem can be characterized fairly 
explicitly for a general Levy process whose Levy measure satisfies some inte- 
grability conditions. This solution is essentially due to Novikov and Shiryaev 
|10] who found it for random walks. Construction was lifted to the framework 
of Levy processes by Kyprianou and Surya [6] (see also Kyprianou [5] Section 
9). In Novikov and Shiryayev [9] the corresponding stopping problem with 
arbitrary power 7 > 0, i.e., g(x) := (x + ) 7 is analyzed. For related problems 
for random walks and Levy processes, see Darling et al. jl], and Mordecki 

The so called Appell polynomials (in [9] a more general concept of Appell 
function is introduced) play a central role in the development directed by 
Novikov and Shiryayev. In the solution, the function V is described as the 
expectation of a function of the maximum of the Levy process up to an 
independent exponential time T. In the paper by Salminen and Mordecki 
[8] the appearance of a function of maximum is explained via the Wiener- 
Hopf-Rogozin factorization of Levy processes and the Riesz decomposition 
and representation of excessive functions. 

The aim of this note is to study the Novikov-Shiryayev solution in light of 
the results in [8J. In particular, we focus on finding the representing measure 
of the excessive function V. In the spectrally positive case the representing 
measure has a clean expression in terms of the Appell polynomials of Xt- In 
the general case we are able to find the Laplace transform of the representing 
measure but unable to find a "nice" inversion. If X is spectrally negative, 
this Laplace transform is expressed in terms of the Levy-Khintchine exponent 
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of X. 

In the next section basic properties and examples of Appell polynomials 
are discussed. Therein is a short subsection on Levy processes where we 
present notation, assumptions and features central and important for the 
application in optimal stopping. In Section 3 - to make the paper more read- 
able - the results from [10] and |S] are shortly recalled. After this we proceed 
with the main results of the paper concerning the representing measure of V. 



2 Appell polynomials 

2.1 Basic properties 

Let rj be a random variable with some exponential moments, i.e., there exists 
u > such that 

E (e" 1 " 1 ) < oo. 

A family of polynomials {Q^ ; k = 0, 1, 2, . . . }, the Appell polynomials as- 
sociated with 77, are defined via 



OO f. 

v ' k=0 

Putting here x = r] + z and taking expectations we obtain easily the so called 
mean value property of the Appell polynomials 

e(q<% + *))=**. (2.2) 

Writing 

1IT OO OO u 

E( e «?) ~ ^ t\ X 2s kr k [ ' 

v ' i=0 fc=0 

and rearranging yields 

Consequently, taking derivatives, it is seen that the Appell polynomials sat- 
isfy 

^ x Q^{x) = mQtlUx\ (2.4) 
Q ( j\x) = 1 for all ar. (2.5) 
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The recursion in (12.41) if combined with the normalization (cf. 

E(Q n (77)) = On = l,2,... 

provides an alternative definition of the Appell polynomials. 

Recall that the cumulant function associated with rj is defined as 

OO f, 

#(«):= log E(e^)=£« fc ^, (2.6) 

k=0 

and the coefficients Kk, k = 0, 1, ... , in the above McLaurin expansion are 
called the cumulants of rj. We remark that 

Kl = E( V ), k 2 = E (fa - Efa)) 2 ) , K 3 = E((ri- Efa)) 3 ) 

but 

K 4 / E ((77 - Efa)) 4 ) . 
It is easily seen that the first Appell polynomials can be written as 

Qt'\x) = l 1 Q[ t1 \x)=x-k 1 , Q^(x) = (x- Kl ) 2 -/€ 2 . (2.7) 

It is also possible to connect the cumulants and the origo moments via the 
Appell polynomials. To do this notice that 

K'(u) = 2.8 

(jr(U) 



where 

OO 

G(u) :=E(e™?) = 



u k 



k\ 

k=0 



is the moment generating function of r] and are the origo moments. Equa- 
tion (12. 8p takes the form 

OO k OO ^ OO 

E**«| = E/^E^'(°)^ 

k=0 i=0 ' k=0 

leading to 

m / \ 

Wi = EU fei&(0). (2.9) 

k=0 ^ ' 



Notice also that if r]i and r) 2 are independent random variables with some 
exponential moments and if r\ := 771 + 772 then 

m f \ 

Q$(* + v) = E uWPWQ^M- (2-io) 

k=0 ^ ' 

This results after a straightforward computation from the identity 

e u(x+y) Q ux) Q uy 



E(e W7 >) E(e u ^) E(e u? ?2)' 

Remark 2.1. i£ zs perhaps amusing to notice that A2.10\) when combined 
with ( PL £j) /eads to Newton's binomial formula. Indeed, 



k=0 

and taking expectations yield 



k=0 ^ ' 



Example 2.2. Let rj be normally distributed with mean and variance 1. 
Then 

e ux ( 1 2 

- exp \ux — —u 



E (e w ») V 2 



~ ~ (-u 2 /2) 1 

2s k\ ^ 11 

k=0 1=0 



EE 



1 Vr l 

L ) X „,2l+k 



k\ l\ I 1 

k=0 1=0 



-u 



00 



u m (-i) l x 



ml m ' ^— ' 



m\ <-^> (m-2/)!/!2 r 

m=0 /=0 V y 



Consequently, 



^ 2 J / iV™m-2Z 



(m- 2/)!/!2 r 

z=o v y 



and, hence, The Appell polynomials associated with a N(0, 1)- distributed ran- 
dom variable are the Hermite polynomials He n , n = 0, 1, . . . , (see Schoutens 
jn$ p. 52, and Abramowitz and Stegun [1 } 22.3.11 p. 775, 22.11 p. 785). 

Example 2.3. We calculate the Appell polynomials of an exponentially dis- 
tributed random variable. To pave the way to the applications below, consider 
a standard Brownian motion B = {B t : t > 0} starting from and its run- 
ning maximum M t := sup s<t B s . Let T be an exponentially with parameter 
r > 0, distributed random variable independent of B. Then Mt is exponen- 
tially distributed with mean l/v2r\ We find the Appell polynomials associated 
with Mt- Since 



E(e" Mr )= l} T , u<V^. 
V2r — u 



we have 



2r it ^ ux 



E(e uM T) ^27 

OO 



00 h 

u" 1 , v-^ u X 



kl ^ k\ J2r~ 

k=0 k=0 V ^' 



00 

11" / / - \ 

fc-1 



Eu k ( k 



k=l 

Hence, the Appell polynomials are 



kl V v 7 ^, 



Q^ T \x)=[x-^=)x n -\ n = 0,l,.... 



2r 

Recall also that Bt is Laplace- distributed with parameter \/2r and, hence, it 
holds 

2r 

E {e uBT ) = -, \u\ < V2r~. 

2r — u l 

Proceeding as above we find the Appell polynomial associated with Bt ■ 

e ux 2r — u 2 



E(e uB T) 2r 



■e ux 



IF 



U k ( 2 k{k-l)\ k _ 2 



k=0 



kl \ X -—2r— ]X 
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Let B' be an independent copy of B, and introduce I' t := mf s < t B' s . Since 

(d) , 
Mt — —It it holds 



(I T )U\ _ / ry* _J_ ^ \ ^-1 



It is well known (the Wiener-Hopf factorization) that 

(d) 

X T = M T + I T , 
and it is straightforward to check (cf. Ii2.10\) ) 

m / \ 



k=0 



2.2 Levy processes 

Let X be a Levy process as introduced above and T an exponential (param- 
eter r > 0) random variable independent of X. Our basic (rather restrictive) 
assumption on X is that Xt has some exponential moments, i.e., for some 
A > 

E(exp(A|X T |)) < oo. (2.11) 

Define 

M T = sup X t and I T = inf X t . (2.12) 

0<t<T ' 0<i<T 

By the Wiener-Hopf-Rogozin factorization 

X T = M T + I' T , (2.13) 

(d) 

where I T is an independent copy of It and = means that the variable on 
the left hand side is identical in law with the variable on the right hand side. 
From assumption (12. lip it follows using ( 12. 13ft that also Mt and It have 
some exponential moments. Moreover, under assumption (I2.1ip . we have 

E(exp(AX T )) 



r — ^(A) 
where 

V( 7 ) = a 7 + h 2 7 2 + j (e^ - 1 - 7*l{M<i}) n(tte). (2.14) 
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is the Levy-Khinchine exponent of X, i.e., 

E(exp(AX 4 )) =exp (tip(\)) . 

Notation II stands for the Levy measure, i.e., a non negative measure defined 
on R \ {0} such that J(l A x 2 )U(dx) < +00. Clearly, it follows from f [2TTj) 
that for all a > and 7 > 



poo r~ a 

I e 7X U(dx) + / e" 7X U(dx) < 00, 

J a J — 00 



but it is still possible to have 

n{(0,a) + n{(-a,0) = 00 

or 

a;II((i2;)+ / |x| II(d:r) = 00. 

J — a 

In case X is spectrally negative, i.e., II((0, +00)) = 0, the process moves 
continuously to the right (or upwards) and is exponentially distributed 
under P with mean l/$(r) where $(r) is the unique positive root of the 
equation ip(X) = r (see Bertoin [2] p. 190 or Kyprianou [5j p. 213). From 
Example 12.31 it is seen that the Appell polynomials associated with Mt are 

Q { n MT \x) =U- ^-r) x n ~\ n = 0, 1, . . . . (2.15) 

In case X is spectrally positive, i.e., IT((— 00, 0)) = 0, the process moves 
continuously to the left (or downwards) and —It is exponentially distributed 
under Po with mean l/$(r) where $(r) is the unique positive root of the 
equation = r. From Example 12. 3 1 it is seen that the Appell polynomials 

associated with It are 

Q^\x) ={x + ) x n -\ n = 0, 1, . . . . (2.16) 

3 Optimal stopping problem 
3.1 Review of three theorems 

We recall now the solution of the optimal stopping problem (II .ip from |10| 
and j6]. We assume that r > 0, and recall that T is an exponentially (with 
parameter r) distributed random variable independent of X. 
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Theorem 3.1. Assume 

/ x n Ii(dx) < oo. 

Then E(M?) < oo and 

V(x) := sup E x (e— (X+) n ) = E {Q { n M \M T + x)1 {Mt+:c><} ) 

and 

r* = wf{t > : X t > x*J 

is an optimal stopping time, where Q( M ^ is the Appell polynomial associated 
with Mt and x* n is its largest non-negative root. 

Remark 3.2. The proof of Theorem \3.1\ uses the fact that 

Q^ J \x)<Q for all ace (OX) (3- 1 ) 
(see fTO^). This property is based on the fluctuation identity 

E x (e" r ^ X n Ha l [Ha<oo} ) = E (gi M) (M T + x)l [MT+x>a} ) , (3.2) 

where a > and H a := mf{t : X t > a}. Notice that 113. 1\) is not valid in 
general for Appell polynomials of a non-negative random variable. Indeed, 
from \2. 7j) we have, e.g., 

Q^(0)>0 if 2(E(r/)) 2 > Efo 2 ). 

Example 3.3. Using the result in Theorem \3.1\ it is easy to find the explicit 
solution of the problem for spectrally negative Levy processes. Indeed, recall 
from previous section that Mt is exponentially distributed with parameter 
$(r), the Appell polynomials associated with Mt are given in Ii2.15\) . and 
x* n := n/$(r). With this data we obtain 

supE, (e— (X+) n ) = E x (Ql M ^ (M T ) ; M T > <) 

n \ _j . , . n 



E-r Mt — ttt MS ■ M T > 



$(r) y i ' $(r) 



7i/4>(r) 



e^W / y n $(r) e~ v ^ r) dy - ny 11 ' 1 e~ y *^ dy 

\Jn/<£>(r) Jn/<S>(r) 



n 



e -n e x<!>(r) 



Therefore, the value function of the optimal stopping problem is given by 

{x n , if x > n/$(r), 

„ 
{W)Y e- n e**M i/z<n/$(r). 

Clearly, the solution has the smooth-fit property. 

Next we recall the result from [8] which characterizes the value function 
via its representing measure. The theorem is proved in |8j for Hunt processes 
satisfying a set of assumptions. In particular, it is assumed that there exists 
a duality measure m such that the resolvent kernel has a regular density with 
respect to m (for the assumptions and a discussion of their validity for Levy 
processes, see [8]). This density is denoted by G r , and it holds 

P X (X T e dy) = rG r (x,y)m(dy) = rG r (0,y - x)m{dy) 

Theorem 3.4. Consider a Levy process {X t } satisfying the assumptions 
made in [8], a non-negative continuous reward function g, and a discount 
rate r > such that 

E x (supe- rt g(X t )) < oo. (3.3) 
t>o 

Assume that there exists a Radon measure a with support on the set [x*, oo) 
such that the function 

V(x) := I G r (x,y)a(dy) (3.4) 

J [a:*,oo) 

satisfies the following conditions: 

(a) V is continuous, 

(b) V(x) — > when x — > — oo. 

(c) V(x) = g(x) when x > x* , 

(d) V(x) > g(x) when x < x* . 
Let 

t* = inf{t > 0: X t > x*}. (3.5) 
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Then r* is an optimal stopping time and V is the value function of the optimal 
stopping problem for {X t } with the reward function g, in other words, 

V(x) = sup E x (e- rT g{X T )) = E x (e~ rT * g(X T *)) , x G R. 
In case r = +00 

e- rr g(X T ) :=\imsupe- rt g(X t ). 

t— >oo 

Next result, also from [8], gives a more explicit form for value function 
V via the maximum variable Mr. The result is derived by exploiting the 
Wiener-Hopf-Rogozin factorization. For simplicity, we assume that It has a 
density. 

Theorem 3.5. Assume that the conditions of Theorem \3.J\ hold. Then, there 
exists a function H: [x*,oo) — > R such that the value function V in (13. 4p 
satisfies 

V(x) = E x {H{M T ) ■ M T > x*) , x<x*. 
Moreover, the function H has the explicit representation 

H{z) = r- 1 f fj(y - z)a{dy), z > x\ (3.6) 

J X* 

where fj is the density of the distribution of It- 
3.2 Representing measure 

Let now V denote the value function for problem (II. ip as given in Theorem 
I3TT1 

V(x) = E {Ql M \M T + x)1 {Mt+x><} ) . (3.7) 

This function has the properties (a)-(c) of Theorem 13.41 (a) and (b) follow 
from monotone convergence, (c) and (d) from the properties of the Appell 
polynomials (or from the fact that V is indeed the value function of the 
problem). Therefore, it is natural to ask whether it is possible to find a 
measure a n , say, such that (13. 6p holds, i.e., 

Ql M \z) = r" 1 f fj(y - z)a n (dy), z > x* n . (3.8) 

From this equation it is possible to derive an expression for the Laplace 
transform of a. 
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Proposition 3.6. There exists a measure a n such that Ii3.8\) holds. The 
Laplace transform a n of this measure is given by 



OO 



^(7) : = / e iy a n (dy) 

Jx* 

= rg n ( 7 ,<)/E(e^) (3.9) 

00 k 

= E^(7X)Ql J) (0), (3-10) 

k=0 



where 



00 



Ul,<)--= / ^ z Q ( n M \z)dz 



n\ e 

(n 

i=0 



/ -M i+1 Qn-iO^n) (3.11) 



with Ql_[(x* n ) >0, i = 0,l,...,n. 

Proof. Multiply equation (13.81) with e~' yz and integrate over (a;*, oo) to obtain 
(to simply the notation we omit the subindex n) 

oo /*oo pz 

e -^Q(M)^ dz = r -i dze^ /z a(dy)f I (y-z) 

* J X* J X* 

poo poo 

= r" 1 / a(dy) / dz e^* f T (y - z) 

J x* J y 

poo poo 

= r' 1 / a{dy) e~™ / dze^^ f T (y - z) 

J x* J y 

poo poo 

= r" 1 / a(dy)e-™ dze~^ u //(-«). 

Jx* JO 

In other words, a is well defined (by the assumption that If has some expo- 
nential moments) and satisfies 

a( 7 ) = rg( 7 ,x*)/E (e^) , 

which is (13. 9p . To obtain ( 13 . 1 0[) use the definition of Appell polynomials (see 
(12. ip . and identity (I3.1ip is a straightforward integration using (12. 4p . Finally, 
notice that the positive zeros x* n of Qn^\ respectively, satisfy 

*-^2 — * * * 
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This follows readily again from (12. 4p and the fact that x* k is the unique 
positive zero of Q^- Hence, \ x n) > for /c = 0, 1, . . . , n. □ 

In case X is spectrally negative the value function can be determined 
explicitly as demonstrated in Example 13.31 However, the Laplace transform 
of the representing measure does not seem to have an explicit inversion. To 
discuss this case more in detail, recall that My is exponentially distributed 
with parameter $(r). Hence, we can relax our assumptions on exponential 
moments. It holds for 7 > 

7X2 



E {e lXT ) 



r - ^(7) 

and, by the Wiener-Hopf factorization, 

E (.*) = E /E (e*) = ^Z7(l)Y (3 ' 12) 

Notice also that Qk(%n) = (n — k)n k / ($(r)) fc . To conclude this discussion, 
we formulate the following 

Corollary 3.7. If {X t } is spectrally negative then 



a 



n (dx) = rg n ( 7 ,<)/E (e"*) = fcfrX) *^ ^ 

<P(r) — 7 



and 

?„(7,<):= / e-i*QM( z )dz 



X 



n , if n , 

(n-i)\ Y+i $( r ) \§{r) ) ' K ' ! 

For spectrally positive Levy processes we do not, in general, have any 
explicit knowledge of the Appell polynomials Q( M ^ and, hence, also the value 
function V remains hidden. However, in this case we may charaterize o n 
nicely. This is possible since now —It is exponentially distributed and we 
see from f l3.8|) . roughly speaking, that Q^ M > is the Laplace transform of a n . 
We obtain also a new expression for the value function. 
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Corollary 3.8. If X is spectrally positive then 

a(dx) =rQ^\x)dx, x > x* n , (3.14) 

and, hence, 

V(x) = E {Ql x) (X T + x) ■ X T + x > x* n ) . (3.15) 

Proof. The Appell polynomials for Ij- are given explicitly in (I2.16p . and we 
have Q ( It) {0) = 1, Q[ It) {0) = l/$(r), and Q ( n T) {0) = forn = 2, 3, . . . . 
From f)3.10p we obtain 

r 

a( 7 ) = rq[j) + T — jq[j). (3.16) 
$(r) 

Consider 

POO 

7 g( 7 )= / ie -^Qi l M \z)dz 

J X* 

oo 

72 



-^Q ( ™Hx)dx) dz 
J x , dx J 

Q ( n M) {%)^ X dx 

n Qn-i( X ) e ~ 1X dx, 



7 e 

x* 
oo j 

" ~ (M) 

* dx 

00 



where we have changed the order of integration, used the fact x* n is a zero of 
Qn*\ and applied the differentiation formula (12.41) . Consequently, we have 
done the inversion and it holds 

a(z) = rQW\z) + n^-Q^z) 
$(r) 

= r (QW(z)QiP(0) + «©!,"> MOl" (0) 

= '-E(!)eSw^ /, (o) 

= rQ ( *\z), 

since Q^(0) = for k — 2, 3, . . . and, in the last step, formula (I2.10p is 
applied. □ 
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We conclude by studying Brownian motion from the point of view of 
Corollary E£3 

Example 3.9. The resolvent kernel with respect to the Lebesgue measure is 
given by (see, e.g., Borodin and Salminen J3j p. 120) 

G r (x,y) = ^=e-^-y\ } 



and, from Example \2.3[ x* n = n/y/2r and 

It is straightforward to check that V as given in Example Iff. 31 satisfies 

POO 

V(x)=r / G r {x,y)Q^\y)dy. 
= E X (Q^\X T ) ; X T > x* n ) . 
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